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Abstract. Let E he a, rank 2, degree d vector bundle over a genus g curve C. The loci 
of stable pairs on E in class 2[C] fixed by the scaling action are expressed as products of 
Quot schemes. Using virtual localization, the stable pairs invariants of E are related to 
the virtual intersection theory of Quot E. The latter theory is extensively discussed for 
an E of arbitrary rank; the tautological ring of Quot E is defined and is computed on the 
locus parameterizing rank one subsheaves. In case E has rank 2, d and g have opposite 
parity, and E is sufficiently generic, it is known that E has exactly 2* line subbundles 
of maximal degree. Doubling the zero section along such a subbundle gives a curve in 
the total space of E in class 2[C]. We relate this count of maximal subbundles with 
stable pairs/Donaldson- Thomas theory on the total space of E. This endows the residue 
invariants of E with enumerative significance: they actually count curves in E. 



1. Introduction 

This note is concerned with the Gromov-Witten (GW), Donaldson-Thomas (DT), and 
Pandharipande-Thomas stable pairs (PT) residue invariants of the total space of a rank 2 
bundle E over a smooth proper curve C (see ^for a brief review). The latter invariants are 
well-understood from a computational perspective. In this paper I attempt to shed some 
light on the enumerative significance of such invariants and to explain the relationship 
between sheaf theoretic curve counting on E and the virtual intersection theory of Quot 
schemes of symmetric products oi E. In particular, in f31 I explain how to relate the 
"count" of maximal subbundles of E (which belongs properly to the theory of stable 
bundles on curves) with the DT/PT theory of E. 

Recall that the Quot scheme of a trivial rank n bundle on a smooth proper curve C 
may be viewed as a compactification of the space of maps from C to a Grassmannian. The 
relationship between the virtual intersection theory of this Quot scheme and various "Gro- 
mov invariants" has been studied by many authors |PR| . |Berj . |BDW) . |M0) . culminating 
in the theory of stable quotients [MOP] where the curve C is also allowed to vary, as it is 
in GW theory. The relationship between GW invariants of Grassmannians and counts of 
subbundles of maximal degree has also been studied by several authors |Hol| , |LN] , |0T] . 
These connections, however, are rather difficult to make, and one must take a circuitous 
route to link maximal subbundle counts to GW invariants. Since counting maximal sub- 
bundles is an inherently sheaf-theoretic problem, it is reasonable to suspect that the most 
direct connections with curve counting should be made through the sheaf theoretic curve 
counting theories of Donaldson-Thomas |Tho| , |MNOP| and Pandharipande-Thomas [PT] . 

In general, the relationship between the PT theory of E and virtual intersection theory 
on the various Quot Sym" E is quite subtle; we will treat the general case in a separate 
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paper j Gil2j . In the present article, we will focus on the case of PT residue invariants in 
homology class 2[C] (twice the class of the zero section of E), where the most complete 
results can be obtained. In particular, we will see that PT residue invariants of E in class 
2 [C] are completely determined by virtual intersection numbers on Quot Oc (symmetric 
products of C) and on the Quot scheme Quot^ E parameterizing rank one subsheaves 
of E. Our methods could even be used to compute the full PT theory of E (including 
descendent invariants involving odd cohomology classes from C) in class 2[C], though we 
do not provide the details here. 

Once we have in hand the relationship between PT theory and virtual intersection 
theory of Quot schemes described above, we will be all the more interested in the latter. 
In N2.41 we suggest packaging this theory into a "tautological ring." In the course of proving 
the Vafa-Intriligator formula, Marian and Oprea [MOj explained that this entire theory 
can be reduced, via virtual localization, to intersection theory on symmetric products of 
C, hence it can be treated as "known." On the other hand, it is quite painful in practice 
to write down manageable formulas for such invariants and it seemed to me to be overkill 
to appeal to the general results of |MQj for the invariants actually needed in our study. 

Instead, we give (f|2]) a direct computation of the virtual intersection theory of the Quot 
scheme Quot^ V parameterizing rank one subsheaves of a vector bundle y on C as follows. 
The universal such subbundle 5 is a line bundle on Quot^ V x C, hence its dual yields a 
map 5^ : Quot^ V PicC. In case V = Oc this is the "usual" map Sym'^C ^ Fic'^C. 
Just as in the case of the "usual" map, the map 5^ is a projective space bundle when 5^ 
has sufficiently large degree d, and, as in the "usual" case, one can compute the desired 
(virtual) intersection theory by descending induction on d. The only new ingredient is the 
use of the virtual class; otherwise the computation is not significantly different from what 
MacDonald does in [Macj. 

We include a review of the DT/GW/PT correspondence for the residue invariants of 
E in p.Sl In principle, our computations could be used to verify this explicitly in degree 
2[C], though we content ourselves with checking some special cases in ^ 
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Conventions. We work over the complex numbers throughout. All schemes considered 
are disjoint unions of schemes of finite type over C. We write Sch for the category of 
such schemes. Set T := Gm = SpecC[t, t^"*^]. We will often consider an affine morphism 
/ : y ^ A, in which case a T action on Y making / equivariant for the trivial T 
action on A is a Z-grading on f^Oy as an Ox algebra (so the corresponding direct sum 
decomposition is in the category of Ox modules) . A T equivariant Oy module is then the 
same thing as a graded fn^Oy module. Throughout, if vr : — t- A is a vector bundle on 
a scheme A, we use the same letter to denote its (locally free coherent) sheaf of sections, 
so E = Specx Sym* E"^ . The sheaf Sym* i?^ has an obvious Z-grading supported in 
nonnegative degrees; we call the corresponding T action the scaling action. If Z C E is a 
subscheme, then by abuse of notation, we will also use vr to denote the restriction of vr to 
Z. 
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When T acts trivially on X, the T equivariant cohomology H^(X) is identified with 
H*(X)[i]; a T equivariant vector bundle V on X decomposes into eigensubbundles V = 
ffira^ where T acts on Vn through the composition of the character A i— )• A" and the scal- 
ing action. For n ^ 0, the T equivariant Euler class CTiVn) is invertible in the localized 
equivariant cohomology H.^{X)t = H* {X)[t,t~^]. The eigensubbundle decomposition in- 
duces an analogous decomposition Kt{X) = Q^K(X) of the T equivariant vector bundle 
Grothendieck group of X and ct descends to a group homomorphism 

eT:e7.\{0}K{X) ^ (H^(X)^•) 

V-W ^ eT{V)eT{W)-^ 

which plays a fundamental role in (virtual) localization. 

Tensor products are usually denoted by juxtaposition and exponents. Notation for 
pullback of sheaves is often omitted, so E sometimes means f*E for a morphism / which 
should be clear from context. 

2. QuOT SCHEMES 

Let C be a smooth projective curve, E a vector bundle on C. Recall [Grol that the 
quotient scheme Quot E € Sch represents the presheaf on Sch which associates to Y the 
set of exact sequences 

0^ S TT^E -^Q^O 

on y X C with Q (hence S) flat over Y (up to isomorphism). In particular, a point of 
Quot E' is a SES 

0^ S ^ E ^ Q ^0 

of sheaves on C. The restriction maps for this presheaf along f : Y ^ Y' are defined by 
pulling back via / x Idc- The identity map of Quot-E corresponds to an exact sequence 

^ S* ^ TilE ^ Q ^ 

on Quot E xC called the universal exact sequence. Let Quof"'"^ E denote the component of 
QuotE' where 5 has rank r and degree e. Note that r, e determine the Hilbert polynomial 
of Q via Riemann-Roch. Quot^'^ is a projective scheme. When r = 1 we drop it from the 
notation and refer to Quot*^ E as the rank one Quot scheme. This will be the main object 
of interest in the later sections of the paper. A subsheaf S of a vector bundle on a curve 
is torsion free since it is contained in a torsion free sheaf, hence it is locally free because 
Oc is a sheaf of PIDs. By flatness, the universal 5 is a locally free sheaf on Quot E x C. 

2.1. Abel-Jacobi maps. Let E he a vector bundle on a smooth proper curve C. The 
determinant A'''S of the universal S is an invertible sheaf on Quof'^ E x C and hence 
defines an Abel-Jacobi map 

ae : Quot^'" E Pic" C 

to the Picard scheme of degree e line bundles on C. Indeed, recall that Pic C = ]Jg Pic"^ C 
represents the presheaf (of abelian groups under tensor product) 



Sch°P ^ Ab 

I line bundles on y X C 
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Fix a point x G C As in [ACGH| IV. 2, we fix, once and for all, a Poincare line bundle L 
on Pic C X C such that the restriction of L to Pic C x {x} is trivial. The pair (Pic C, L) 
has the following universal property, which characterizes it up to tensoring L with a line 
bundle pulled back from Pic C: for any scheme Y and any line bundle L' on y x C, there 
is a unique morphism f : Y ^ PicC such that L' = (f x Idc)*L (8) vr^M for some line 
bundle M on 1". Let Lg denote the restriction of the Poincare bundle L to Pic^C; by 
definition of Pic^ C, Le\{pjxC is a degree e line bundle on C for each point P of Pic*^ C. 
Each of the components Pic*^ C is non-canonically isomorphic to the torus 

ll\C,Oc)/iiHC,^) = Ker(ci : B\C,0*c) }i^{C,Z)), 

so its cohomology is an exterior algebra on H^: 

H*(Pic"C,Z) = A*}1^(Pk^C,Z) 

li E = Oc, then a_„ is just the usual Abel-Jacobi map 

Sym"C ^ Pic"C 
D ^ 0{D), 

once we identify Sym" C with Quot"" E via 

D ^ (Oci-D) ^ Oc). 

The situation is very similar when E is any invertible sheaf. In the case of the rank one 
Quot scheme Quot*^ E, the fiber of over a line bundle L € Pic*^ C is the projective space 

PHom(L,S) 

because any nonzero map L ^ E must be injective. Under the inclusion 

¥Bom{L,E) ^ QuofE, 

the universal subbundle S ^ 'K2E on Quof^ii^ x C restricts to 

0{-l)ML TT^E 
f^l ^ /(/) 

on FRom.{L,E) x C. 

It is well-known that the Abel-Jacobi map a„ : Sym" C Pic" C is a P""^ bundle for 
n > 2g — 2. In fact, a similar statement holds for Quof^ii^, as we now prove. 

Lemma 2.1. For any coherent sheaf E on a smooth proper curve C, there is an integer 
d(j such that }1^{C, E ® L) =0 for every line bundle L on C of degree at least dg. 

Proof. This is an easy consequence of semicontinuity and quasi-compactness of the Ja- 
cobian Pic'^ C. Fix a degree one (hence ample) invertible sheaf Oc{^) on C. Then for 
any fixed degree zero line bundle Lq on C, there is a do such that H^(C, -E (g) Lo(n)) = 
for all n > do. By semicontinuity, H^(C, (S> L{n)) = for all L in a neighborhood 
of Lq in Pic'' C, so by quasi-compactness of Pic'' C we can choose do large enough that 
H^(C, E ® L{n)) = for all n > do for all degree zero line bundles L. As L ranges over all 
degree zero line bundles, L{n) ranges over all degree n line bundles. □ 
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Theorem 2.2. Let E he a rank N, degree d vector bundle on a smooth proper curve 
C, Quot^ E the Quot scheme of rank one, degree e subsheaves of E. For all sufficiently 
negative e, the Abel-Jacobi map Ug ■ Quot^ E — >■ Pic^ C is a P"*~i bundle for m = (1 — 
g)N + d- eN. 

Proof. Let Lg the universal degree e Hne bundle on Pic^ E x C. By flatness, cohomology 
and base change, the lemma, and Grauert's Criterion, 7ri*(Lg (g) 7r|£^) = and 

V:= -ku^LI^-kIE) 

is a vector bundle on Pic^ C of rank m whenever e is sufficiently negative. Let p : PF — )■ 
Pic^ C be the projection, i : Opy (— 1) — >■ p*V the tautological inclusion of bundles on fV. 
The "evaluation" map 

e : <C'py(-l) (2) X IdcYL^ n^E 

f^l ^ if {I) 

is a map of bundles on x C with the correct discrete invariants, hence it defines a 
morphism / : PI/ Quof^ E with (/ x Idc)*j = e, where j : S ^ tt^-E is the universal 
subsheaf on Quot^ E x C. I claim / is an isomorphism. 

To construct its inverse, recall that, by the universal property of ¥V, lifting the Abel- 
Jacobi map Oe : Quot*^ E Pic*^ £' to a map g : Quot^ FV is the same thing as giving 
a rank one subbundle of the bundle a^V on Quot*^ E (under the correspondence, this rank 
one subbundle will then be g*i). By flatness and cohomology and base change in the 
diagram 

Quot^ ExC ^1^^}^ pic^ CxC 

TTl TTl 

Quot'^ E ^ Pic'^ C, 

we have 

alV = al-KuXLi TilE) 

= 7ri,((ae xIdc;)*(L^(g)7r^^)). 

By the universal property of Pic^ C, there is a line bundle M on Quot^ E such that 

(1) (Oe X IdcTLe TtIM = S. 

We then have 

by the projection formula. Tensoring the universal inclusion j : S 7r|-E on Quot'^ ExC 
with 5^ and applying tti*, yields a rank one subsheaf 

In fact it is a subbundle, because otherwise l would fail to be injcctive at some point of 
Quof^ E, which is absurd. Tensoring with Af , we obtain a rank one subbundle 

k ■■= (E) Id^v) (g) Mm : M a*y, 

and hence a morphism g : Quot^ E — > FV with the property g*i = k. 
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The proof is completed by checking that fg is the identity of Quot^ E and gf is the 
identity of FV, which is straightforward. For example, checking that fg = Id amounts to 
showing that {g x ldc)*j = j- We have 

(^xldcri = {gxldcTif xldcTj 
= {gxldc)*e, 

and 

(5Xldcr(7rt0py(-l)®(pXldc)Ue) = (Oe X Idc)*Le 

= 7r*M (g) (ae X Idc)*i^e 
= S. 

Furthermore, if s is a local section of S corresponding to a local section m®l under the 
last isomorphism, then by definition of the evaluation morphism e, we compute 

(5Xldc)*e(s) = {g*i){m){l) 
= k{m){l) 
= j{s), 

where the last equality is just unravelling the definition of A;. □ 

Remark 2.2.1. Although the rank one Quot scheme Quof^ E is always smooth in genus 
zero (it is just the projective space PHom(Opi(e),£^)), it can be singular in general. For 
example, if C has genus 2 and E = Oc ® Oc-, then the fiber of the Abel-Jacobi map 

o_2 : Quot~^ E Pic~^ C 

over the dual L"^ of the g2 on C is 

PHomc(L'^,£;) =P(H°(C7,L)®2) ^ p3 

(the other fibers are P^'s). The singular locus of Quot~^ £^ is a quadric P^ X Pi in this P^ 
fiber corresponding to subsheaves Li^ ^ E whose inclusion factors through an inclusion 
Oc ^ E. The quotient of such a subsheaf is of the form Oc © C^p+q and the tangent 
space at such a point is 4 dimensional, with one dimensional obstruction space 

Exti(L^,Oc © Op+q) = li\C,L) 

(the obstruction space is easily seen to vanish away from this locus). 

2.2. Stratification. Let E he a vector bundle on a smooth proper curve C. The Quot 
scheme Quot'''^£' can be stratified as follows. Let Quotg^^^ be the open subscheme of 
Quot^'^ E parameterizing suhbundles. Define a map 

Ln ■ Quot'^'^+™ E X Sym" C Quot^'^ E 

{S ^E,D) ^ {S{-D) ^S^E) 

(this obviously makes sense on the level of universal families). Each map i„ is a closed 
embedding. We obtain a stratification 

Quot^'^ ^ = II in[Quot[;''+''" E X Sym" C] 

n>0 



by locally closed subschemes. It is finite since Quot'''^"'"'"" E is empty for large n. 
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In the rank one case, this stratification respects the Abel-Jacobi maps of (|2.ip in the 
sense that aein = Oe+n ® ci-n, where ® is multiphcation for the abehan variety PicC. 
That is, the diagram 



Quot'^+" E X Quot-" Oc 



-^e + n ^ '-f' — n 



Pic'^+" C X Pic"" C ■ 



Quot^ E 



Pic^C 



commutes. 



2.3. Obstruction theory. Let be a vector bundle on a smooth proper curve C as 
usual and let tt : Quot E x C ^ Quot E be the projection. The goal of this section is to 
show that there is a map 

(2) R ^om(R TT^.J^om{S, Q) , Oquot e) I-Quot E 

to the cotangent complex of Quot E (see [Hlj) defining a perfect obstruction theory (POT) 
on Quot E in the sense of Behrend-Fantechi [BF] . Our proof basically follows the proof 
of Theorem 1 in |MOj . but we work with the Behrend-Fantechi formalism as opposed to 
that of Li-TianQ Following [MOj . we produce an embedding from Quot-E into a smooth 
schem^ so that Quot E is realized as the zero section of a vector bundle with the expected 
rank. We then simply identify the paradigm POT on this zero locus (whose virtual class 
is cap product with the Euler class of the bundle; see Section 6 in [BF]) with the map ([2]). 

Before carrying this out, I should mention that this is probably not "the best" way to 
construct this POT. A more intrinsic construction of this POT appears in my paper [Gill] . 
The idea there is to use the "reduced Atiyah class" of the universal quotient, which is a 
map 

S vr*LQuotE <X) Q 

in the derived category L)(Quot ExC). Tensoring with the derived dual of (the perfect 
complex) Q and tracing, this yields a D(Quot-E' x C) morphism 

Using Serre duality for vri, one can show that this is the same thing as a map ([2]). It is 
shown in [Gillj that this is a POT. It can be shown that the POT we will construct here 
coincides with the POT constructed in Gill] , though we will omit this argument in the 



interest of brevity. We have chosen to present this version of the construction of the POT 
to keep the paper self-contained. 

Let j : -D C be an effective divisor in C of degree n and consider the embedding 

iDiQuof'^S ^ Quot^'"-™^ 
(S^E) ^ {S{-D) ^ E) 

obtained by restricting the map ifi from the previous section to 

Quot''-^ Ex{D}^ Quot'''^ E. 



is not obvious to mc that anything in the work of |MO| actuaUy leads to a map hke 

o 

In fact, we will use the smooth locus of Quot E, but the embedding will not be the identity map. 
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To save notation, set 

Z := Quof^'^^ 
X ■- Quot'^'^-''"^; 

and write -)■ 5 ->■ ttIE' Q -)• for the universal SES on X x C. 
By definition of i£), we have a commutative diagram with exact rows 

^S{-D) ^-kIE ^0 







Q 







on Z X C, where the top row is the pullback of the universal sequence on X x C via 
iD X Idc (we should probably write Q\zxC instead of Q) and the bottom row is the 
universal sequence on Z x C. By abuse of notation, we also write j for j times the identity 
map of either Quot scheme, so the cokernel of the left vertical map can be written j*j*S. 
By the Snake Lemma, the right vertical arrow fits into an exact sequence 



(3) 



^ j^j*S ^Q^Q^O. 



Lemma 2.3. For a divisor D C C of sufficiently large degree n, the embedding ld factors 
through the smooth locus of X = Q,uot^''^~^"^ E. 



Proof. By compactness of Z = Quot^'*^ E and semicontinuity, we can choose a D with 
degree large enough that 



(4) 

for every point z of Z. 



B.\C,jeom{S, Q)I^(D)) = 



We will use the formal criterion for smoothness, so we must show that we can solve the 
lifting problem 



Y 



Z^—^X 



SpecC 



whenever Yq ^ Y is a closed embedding of affine schemes with square zero ideal /. By 
basic obstruction theory of quotients, it is equivalent to show that the obstruction to such 
a lift in 

vanishes, so it suffices to prove that this whole vector space is zero. The functor HomygxC 
is the composition of three functors: 

HomygxC = r o TTi* o JfomYoxC, 

so to prove the vanishing of 

Extyoxc(^>Q® TTi/) = R^Homyoxc(5,g(g)7ri/), 
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it suffices (by the Grothendieck spectral sequence) to prove the vanishmg of the three 
vector spaces 

{Yo, vru JTomjSVQ vr*/) 
R\Yo,7ru^xt\S,Q®TTlI)) 
R^{Yo, TTi* jrom(5, Q) I)). 

The first vanishes because Yq is affine and the second vanishes because 5 is locahy free. 

For the third vanishing, we will show that 7ri^:J^om{S, Q) = 0. By cohomology 
and base change and the assumption that Yq ^ X factors through we might as well 
assume Yq = X, so S = S{—D). Using the vanishing (jH) together with cohomology and 
base change (and flatness of M'om{S^ Q)), we first observe that 

R^ -KuJeomiS, Q) = R^ vru jrom(5, Q){D) = 0. 

Next, we tensor the sequence ([3]) with S'^{D) and apply ttu to get an exact sequence 

^ R^ T^uj*j*{S (g) S^{D)) r1 TTuJ^om(S,Q) R^ TTuJ^om(S,Q) 0. 

The term on the left vanishes because vrij has relative dimension zero, so we obtain the 
desired vanishing. □ 

The embedding ld identifies Z with the closed subscheme of X defined by the degeneracy 
locus where the map 

T^uSlxxD — > 7I"l*Vr2-E|xxD 
of vector bundles on X is zero. Indeed, ld identifies the presheaf Quot'^''^ £^ with the 
subpresheaf of Quot'^'^"'^'^ E which associates to a scheme Y the set of 

in (Quot^'*^"'"" £')(y) such that the inclusion j : 5" — )• vrg-E factors (necessarily uniquely) 
as below. 

(5) : 



S{Y X D) 

If Spec(yl (g) i?) ^ X X C is a basic affine open on which S and 7r2E are trivialized and 
D C C is given by / G -B, then j can be viewed as a monomorphism 

j:{A(^ BY ^{A(^ 

of free (A^B) modules. For any A algebra (j) : A C, the morphism SpecC X factors 
through 6£) iff there is a factorization ([5]) with Y = SpecC iff there is a factorization 

{C^BY^^^ (C^B)^ 

(i(g)/)-id; 

of C^B module maps, where j = (Spec (f) x IdsYJ- On the other hand, such a factorization 
exists iff 

3[{C®BY]Qil®f)-{C0Bf 
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iff j (^C»B C^B/f = 0. But 

j ®C®bC B/ f = jlspccCxD 

= (Specc/) X Idz))*(j|xxD), 
which vanishes iff Specc/) x Ido factors through the zero locus of j\xxD iff SpecC — >• X 
factors through the zero locus of t^u{3\xxd)- 

Example 2.3.1. HE has rank one and degree d, then for any n € Z>o, there is an the 
identification Sym" C ^ Quot''-" E which identifies 5^ with 0{D), where D C Sym" CxC 
is the universal divisor. When D = Q \s a point of C, the embedding 



identifies Sym" C C Sym" C with the zero locus of a section of the restriction of 0{D) 
to Sym" C x{Q} = Sym" C. 

Of course, ttIE'IxxD = t^2^\d is a trivial bundle of rank equal to the rank of E, so 
'kwk2E\d is a trivial bundle of rank nN {ttuOxxD is a free Ox module of rank n = degD). 
The degeneracy locus Z may therefore be viewed as the zero locus of a section of the bundle 



In general, if Z is the zero locus of a vector bundle V on a smooth scheme X (smooth 
in a neighborhood of Z is good enough), then there is a map 



(the complex on the left is supported in degrees —1,0) defining a POT on Z whose asso- 
ciated virtual class is just the Chow class eiy) H [X] supported on Z. This is a special 
case of the discussion in Section 6 of |BF) . In the situation of this section, we have: 

Lemma 2.4. The complexes \y'^\z — > andYiJ^om{¥{.TTi^S^Q^Oz) on Z are nat- 

urally quasi-isomorphic. 

Proof. It is equivalent to prove that the dual complex [TX\z ^\z] is naturally quasi- 
isomorphic to Rtti^S'^Q. By basic obstruction theory, we have an identification TX = 
TTi^.S Q. Following through this identification and the definition of the boundary map in 
the paradigm POT, we see that the boundary map TX\z V is identified with vri^, of 
the adjunction map 



LQ : Sym"~i C ^ Sym" C 

+ ^ Pi + --- + Pn-1 + Q 



V:= {ttuS'Ixxd)'' onX. 



[V'lz ^nx\z]^i^z 




S'^SlzxD 



Q 



define quasi-isomorphisms between the complexes (on Z x C) given by the rows, then the 
proof is completed by applying the functor Rvri^,. To see that the bottom vertical arrow 
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is a quasi-isomorphism, just tensor ([3]) with S'^ . To say that the top vertical arrow is a 
quasi-isomorphism is equivalent to saying that the sequence 

(6) O^S''S\zxd^S''Q^s''q^s''q\zxD^O 
is exact. Tensoring the exact sequence 



with Q gives an exact sequence 

^ =^orf ^^(^''izxD, Q) ^ S^'Q ^ S^'q ^ s'^QlzxD ^ 0, 

so we want to show that S'^S\zxD is identified with c'^orf^'-^{s'^\zxD,Q)- Tensoring the 
locally free resolution 

(restricted from X x C to Z x C) of Q with OzxD gives an exact sequence 

^ ^orf ^^(OzxD, Q) ^ S\zxD ^ TT*^E\zxD ^ Q\ ZxD 

of sheaves on Z x C . But by the definition of Z, the the map in the middle is zero, so 
the left and right maps are isomorphisms and we conclude ^orf^^ {OzxD, Q) = S\zxD- 
Since S \zxD is a locally free OzxD module, we have 

^orf'''^{f\zxD,Q) = ^or^''^{OzxD,Q)®S^\zxD 

= S\zxD 
= S"^ S\zxD- 

This proves that Q is exact, hence completes the proof. □ 

Remark 2.4.1. One can show directly that this POT is independent of the choice of 
"sufficiently positive" j : D ^ C hy comparing two such Di , D2 with the inclusion of the 
sum Di + D2. 

2.4. Tautological classses. Let 77 € H^(C, Z) be the fundamental class and fix a basis 
(5i, . . . , for H"^(C, Z) such that = —6gj^i5i = ?? for i G {1, . . . , g(} and all other 5i5j 

are zero. Let S be the universal subbundle on Quot E x C. Let 

Ci{S^) = Oj (g) 1 + ^ bij ^ 5j + fi ^ T] 
j=i 

be the Kiinneth decomposition of Ci{S'^). In the argot of |Mar] . [MO] , etc. the classes 

ai G H2*(Quot^'"S) 
bij G }i^'-\quoe'^ E) 

are called a, b and / classes. 



Definition 2.4.1. A tautological class is an element of the subring R of H*(Quot£^) 
generated by the a, b, and / classes. The tautological ring R* is the quotient of R* by the 
ideal 



{a G R* : / a/3 = for all /3 G R*}. 

JfQuot SI"'' 
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Unlike the actual cohomology ring H*(QuotS), the tautological ring is deformation 
invariant: it does not depend on the curve C or the bundle except through their discrete 
invariants. This follows from deformation-invariance properties of the virtual class and the 
fact that the a, 6, and / classes have globally defined analogues as C, E vary in families 
which restrict to the given classes at points of the family. The virtual intersection theory 
of Quot E is the study of the tautological ring, usually through calculations of integrals of 
tautological classes over the virtual class. A typical result is the Vafa-Intriligator formula 
for integrals of polynomials in the a classes [MO] (for the case E = Oq). 

For later use, let us record some facts about the first Chern class ci(Le) G H^(Pic'^ Cx C) 
of the Poincare bundle discussed on pages 334-335 of |ACGHj . Its Kiinneth decomposition 
looks like 

(7) ci(Le) = O(8)l + ^6i0(5j+e®r/ 

i=l 

(the (2, 0) Kiinneth component is zero because restricts trivially to Pic"^ C x {Q})- Note 
that, by the universal property, any two components of Pic C are identified by tensoring L 
with a line bundle pulled back from C; this only changes the (0, 2) Kiinneth component of 
ci, so the (1, 1) Kiinneth components of Le and are identified under this isomorphism, 
so the bi are "independent of e". Recall that the bi form a basis for H^(Pic''C,Z) ^ I?9 
which is oriented so that 

(8) / bibg+ib2bg+2 ■ ■ ■ bgb2g = 1. 

Jpic" c 

To prove this (following [ACGH| ). one may assume e is large. Consider the divisor 
A + (e — 1)C X {Q} in C X C, where A is the diagonal. By the universal property of 
Pic*^ C, the associated line bundle 

L' :=Ocxc(A + (e-l)Cx {Q}) 

determines a morphism f : C ^ Pic*^ C so that (/ x Idc)*Le differs from L' only by 
tensoring with a line bundle pulled back from C via tti; this doesn't change the (1,1) 
Kiinneth component of ci, so we see that the (1, 1) Kiinneth component of Le pulls back 
via / x Idc to the (1, 1) Kiinneth component of ci(L'), which is just the (1, 1) Kiinneth 
component of the diagonal A: 

29 

1=1 

9 9 
i=l i=l 

To see that /* induces an isomorphism on H^, notice that it factors as a sequence of 
stratification maps (c.f. (12. 2|) . (|2.3I) ) 

LQ : Sym" C Sym"+i C 

Pl + --- + Pn ^ Pi + --- + Pn + Q 

(starting from C = Sym^ C) followed by the Abel-Jacobi map : Sym*^ C Pic^ C. 
Since e is large, is a P*^"^ bundle, hence a* is an isomorphism on H^, and each lq has 
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affine complement and is an isomorphism on H by the Lefschetz Hyperplane Theorem 
(c.f. (12.2) in [Mac] ). 

Set 9 := J2i=ibibg+i G H2(Pic^C7), and let 7 = Y^L^i ® be the (1,1) Kiinneth 
component of ci(Le) as in [ACGHj . Then 7^ = —2r]9, 

(9) / 93 = g\[ hbg+lb2b2+g---bgb2g=g\, 

and 

(10) diLe = 1 + eri + j -r]9 

(dropping notation for pullbacks). 

Let us now focus on ci(S"^) = ci(A''S'^), whose Kiinneth decomposition we will simply 
write as 

ciiS"^) = a®l-^6j(g)Jj-e(g)r/ 

i=l 

for the sake of this discussion. As the notation intimates, 6j is the pullback of 6j G 

H^(Pic'^C) via the Abel-Jacobi map : Quot''''^ -E — >■ Pic*^ E'. Indeed, by definition of Oe 

(Section 12. ip via the universal property of Pic*^ C, (og x Idc)*Le is equal to A^S up to 

tensoring with a line bundle pulled back from Quot*^ E; tensoring with such a line bundle 

does not effect the (1,1) Kiinneth component of ci. Since H*(PicC) is generated by 

H^(Pic C), all classes in H*(Quot E) pulled back via the Abel-Jacobi map are tautological. 

2 

We will usually drop a* from the notation, and simply write, e.g. ^ € R (Quot^'^ E) for 
at9. 

The rest of this section is devoted to determining the tautological ring of the rank one 
Quot scheme. The necessary intersection number formulae will be obtained as sequelae of 
the structure theory of the rank one Quot scheme from (12. ip and the basic properties of 
the virtual class in (|2.3p . 

A monomial in the bi equal to bij)g+i^ ■ ■ ■ hi^bgj^i^ for some distinct «i, . . . , ifc E {1, . . . , (7} 
in H*(PicC) will be called even, while a monomial in the bi not equal to (plus or minus) 
an even monomial will be called odd. The possible "parities" of a (non-zero) product of 
monomials of given parity are: 

(odd) (even) = odd 
(even) (even) = even 
(odd) (odd) = odd or even 

Theorem 2.5. Let E he a vector bundle of rank N and degree d on a smooth proper 
curve C . Set m := (1 — g)N + d — Ne (as in Theorem \2.2\) . For any k £ {0, . . . , g} with 
m — 1 + k > 0, and any even monomial b £ H2f-2fc(Quot'= E), 

[ a"-i+'=6 = N\ 

ifQuot^ E]^^-' 

while this integral vanishes for any odd b. 

Proof. We first prove the theorem when e is sufficiently small. Let vr, be the projections to 
the factors of Pic"" C x C. Since e is smah, 7ri*(L^ ® Tr^-E') = 0, F := -ku {L). ® tt^E) is 
a vector bundle of rank m on Pic*^ C, and Quot*^ E = PI/ (see the proof of Theorem 12. 2p . 
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By GRR and ([7|) we find chV = m — NO. By the proof of Theorem 12.21 we have 5 = 
C'py(-l) (g) (p X Idc)*Le, where p : FV Pic^ C is the projection. Since the (2,0) 
Kiinneth component of Le is zero, a = ci(C'py(l)). The Chern character formula for V 
imphes c{V) = e~^^ (see page 336 in |ACGHj ). so by definition of Chern classes, we have 
the relation 

(11) a'" = a"'~\N9)-a'^-'^^^^ + a"'-^'^^ 

in H*(Py) = i?*(Quot'^^). 

The proof in the small e case can now be completed by induction on k. When k = 0, 
we compute 

/ a'^-'b = [ ci(Opv^(l))'-'^^-i6 



b, 

Pic" C 

which, according to dSD, is indeed given by A^'^ = 1 when b is the unique even monomial of 
degree 2g and certainly vanishes when b is odd (hence zero). For the induction step, since 
k > 0, we can use PT|) to write 

(12) / a^^-'+'^b = [ a"-i+(^-i)(iV0)6-a"-i+(^-2)i^6 + ... . 

Jpv Jfv 2! 

Note 

i<ii<-<ij<g 

is j\ times the sum of all even monomials of degree 2j. If b is odd, then by the rules for the 
parity of a product, ^-'^ is a sum of odd monomials, hence l\12\i vanishes by the induction 
hypothesis. On the other hand, if b is an even monomial of degree 2g — 2k, then [6^ / j\)b 
k^ 



is a sum of ( ^. ) even monomials of degree 2g — 2{k — j) and we have 



/ 

Jf 



FV j- 



by the induction hypothesis, hence 



03 - '^'(0-(2)H3 

= iv^ 

as claimed. 

For a general e, choose a divisor D C C of sufficiently large degree n and consider the 
embedding 

iD ■■ Quot" Quof^"" ^ 

of Section O Fohowing the notation of Section [231 let Z = Quot'^ E, X = Quot''"" E, 
and let S, S be the universal subsheaves on Z x C and X x C, respectively. As in 
Section [231 we have S = S{D)\zxC- The twist by n^OciD) doesn't change the (2,0) 
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Kiinneth component of ci, so we have a = a\z- Let 5"^ := vri^,(5'^|xxD)- Evidently 5^ is 



a vector bundle on X with rank n and Cn{S^) = a". We saw in Section [2T3l that 



[Z]-"- = cnislr n [X] 

(we are assuming that n is large enough that X is a p™--! bundle over Pic^ C, so in 
particular smooth of the expected dimension). Note that 

m = {I- g)N + d- {e-n)N 
= m + nN. 

Since we know the desired formula holds on X, the proof is completed by the following 
computation: 



X 

□ 



The formula 



(13) / 



^m—l+kQg—k H' 

k\ 



is an immediate consequence. The following corollary is also an important special case of 
the theorem. 

Corollary 2.6. Let E he a vector bundle of rank N and degree d on a smooth proper 
curve C and suppose e G Z satisfies 

{I- g){N -l) + d- Ne = ^ 

(i.e. the expected dimension of Quot^ E is zero). Then 

1 = N3. 

[Quot<= EJ^ir 

Notice that the virtual intersection theory of Quof^ E has little dependence on the rank 
of E. In case = 1, Quot*^ E = Sym" C (for an appropriate n) and the tautological ring 
i?*(Quot'^ E) is just the usual cohomology ring of the symmetric product. Presumably the 
tautological ring of Quot*^ E admits a presentation similar to that of H*(Sym" C) given in 
We leave the details to the reader. 

Remark 2.6.1. In case E = Oq is the trivial rank bundle, our Quot'^'"'^ Oq is denoted 
Quot^ in [Berj and [MOj . If P{Xi, . . . , X^.) is a polynomial in r variables, our 

/ P{ai,...,ar) 

J [Quot C>^]vh- 

is Bertram's 

Nd{P{Xi,...,Xr),g). 

In this case, our Theorem 12.51 is a special case of Proposition 2 in |M0| . Indeed, fix s G 
{0, . . . , (7} and indices 1 < ji < • • • < is < 5) so 6 := bjjjgj^j^ ■ ■ ■ bj^bg+j^ G H^*(Quot O^). 



■^Note the slight error pointed out by Bertram and Thaddeus ( |BT) . 2.2). 
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Let m := A^(l — g + d) as usual. Using their notation, let R{x) = P{x) = x™"^"'"^-*^ 
J{x) = N/x. Let C,N be a primitive N^^ root of unity. A very special case of their formula 
yields 

N 

/ a"-i+^-^6 = N-^Y.^CNy^{CN)j{CNr-' 

J[Quot-'*C)^]-'' ^ 

AT 

1=1 

= iv»-^ 

in agreement with our formula. 



3. Curve Counting 



We begin this section with a brief review of various curve counting theories, then in ^3.41 
we explain how to define the "residue" invariants of a rank two bundle E on & curve C for 
each of these theories. Finally, in i j3.5l we recall the (somewhat conjectural) correspondence 
between these residue theories. 

3.1. DT theory. For a smooth 3-fold X and /? G H2(X), let /n(X,/3) denote the Hilbert 
scheme of ideal sheaves / C Ox of 1-dimensional subschemes Z <Z X with [Z\ = (3 and 
x{Oz) = n. Viewing this as the moduli space of rank one torsion free sheaves with trivial 
determinant (and the appropriate discrete invariants), the fixed determinant deformation 
theory of sheaves endows this space with a perfect obstruction theory (POT) and hence a 
virtual fundamental class 

[UX,f3)r gAMX,/3)). 

The tangent and obstruction spaces at a point / G In{X, 13) are given by the traceless Ext 
groups 

Exti(/,/)o, Ext2(/,/)o, 
respectively and the expected dimension e is given by 

dimExt^(/,/)o -dimExt2(/,/)o = / ci{TX) 

( |MN0P"2] . Lemma 1). The Donaldson-Thomas (DT) invariants of X are defined by 
pairing various cohomology classes on In{X,l3) with the virtual class. 

3.2. FT theory. Let P„(X, /3) denote the moduli space of (flat families of) pairs {F,s) 
consisting of a sheaf F on X and a section s € ^{X,F) satisfying: 

(1) The support of F is one dimensional and [SuppF] = j3. 

(2) x{F) = n 

(3) F is pure: any subsheaf G d F with zero dimensional support is zero. 

(4) Coks has zero dimensional support. 

The purity of F ensures that Suppi^ is a Cohen-Macaulay (CM) curve of pure dimen- 
sion one (no embedded points). This is the stable pairs moduli space of Pandharipande- 
Thomas. It also carries a POT and a virtual class 



[P„(X,/3)r GAe(P„(^,/3)) 
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reflecting the fixed determinant deformation theory of the two term complex 

/• := [s:Ox^ F] 

(sitting in degrees 0, 1) in the derived category of X] the deformation and obstruction 
spaces at a point I* are again given by traceless Ext groups: 

Exti(/',/')o, Ext2(/',/')o. 

The expected dimension is again given by 

dimExt^(/',/')o -dimExt2(/',/')o = / ci{TX) 

(the proof is the same as that of Lemma 1 in |MNUP2] and is hence omitted in |PTj ). 

It is a standard fact ( |PTj . 1.7) that the cokernel of s is the ideal sheaf Iz of Z := SuppF 
in X, so we have an exact sequence 

^ Iz ^ Ox ^ F ^ Cok s ^ 0, 

hence x{F) = xi^z) + x(Coks). Since Coks has zero dimensional support, the second 
term is nonnegative and is just the length of Coks. The Pandharipande- Thomas (PT) 
invariants of X are also defined by pairing various cohomology classes on P„(X, ^5) with 
the virtual class. 

3.3. DT=PT for minimal n. Fix (5 and consider the minimum n so that P„(X, /3) is 
non-empty. Then we have an isomorphism Pn{X,f3) = In{X,/3) identifying the POTs on 
the two spaces. This is because minimality of n ensures that every stable pair is just 
the natural surjection Ox Oz onto the structure sheaf of a CM curve Z C X of pure 
dimension one. Similarly, minimality of n ensures that every curve Z € In{X,(3) is CM of 
pure dimension one, else we could pass to the subcurve Z' C Z defined by the largest ideal 
/ C Oz with zero dimensional support to obtain a curve with smaller Euler characteristic. 
The structure sheaf of such a CM curve is pure, hence it defines a stable pair Ox — > Oz- 
The POTs are identified since the complex /* = [Ox Oz] associated to a stable pair 
of minimal Euler characteristic is quasi- isomorphic to the ideal sheaf of Z. 

3.4. Residue invariants. Let be a rank two vector bundle over a smooth proper curve 
C. The total space of is a smooth 3-fold with 112(E) = Z[C] generated by the class 
of the zero section; we will often just write b for b[C]. The GW, DT, and PT "residue" 
invariants of E are defined by formally applying the virtual localization formula using 
the natural T action on E by scaling (which induces a T-action on each moduli space 
in question making the perfect obstruction theory T-equivariant). For example, the GW 
invariants of E are defined by 

Mg,b{E) := [_ eT{-7rJ*E), 
J[A/*,o(C,fe)]-^ 

where vr is the universal domain curve and / is the universal map. The integral is equi- 
variant pushforward to a point and takes values in the localized equivariant cohomology 
ring of a point (i.e. the ring of rational functions of the generator t of the equivariant co- 
homology ring of a point). The superscript • indicates that the domain curve S of a stable 
map may be disconnected (note g := 1 — x(C's) can be negative) though no connected 
component can be contracted to a point. Note that the T-fixed stable maps are just the 
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stable maps to the zero section and the T- fixed part of the GW POT is nothing but the 
POT on stable maps to the zero section. 

Similarly, the PT invariants of E are defined by 

where the integral is again equivariant pushforward to a point. Here [Pn{E , b)'^Y^'^ is the 
virtual class associated to the POT on Pn{E,b)'^ obtained from the T fixed part of the 
POT on Pn{E, b) and A^^"' is the moving part of this POT (we will examine this closely in 
Section [6|), viewed as an element of (perfect, T-equi variant) K ring KT{Pn{E,b)^). The 
DT invariants In,b{E) are defined similarly. It is not obvious that these invariants have 
any enumerative meaning, though our goal is to show that they do. 

3.5. GW/DT/PT residue correspondence. The GW, DT, and PT residue invariants 
are all T-equivariant-deformation invariant, so they are independent of the choice of degree 
d bundle E, hence we may write Mg^h{d), In,bid), Pn,b{d) in lieu of Mg^h{E), In,b{E), Pn,biE). 

Let 

Z^'^idXu) := j;M,,5(d)t.2^'-2GQ(t)((^.)) 
g 

n 
n 

be the generating functions for these invariants. Let 

oo ^ 

^(9) ■■= n (13^ 

n=l 

denote the MacMahon function (the generating function for plane partitions). The GW/DT 
correspondence proved in [OP] says that 

(14) Z^'^{d) = M{-qf3-^-'^ 

(this is a special case of Conjecture 1 in |BP2j ). that the reduced DT partition function 
Z^'^^'^{d) := Z^"^ (d) / Zq''^ (d) is a rational function of q, and that 

(15) (-m)''(2-2^;+<i)^GW(^) ^ (_^)(-6/2)(2-2p+d)^rcdDT(^)_ 

(These are the "absolute" special cases of Theorems 1,2, and 3 in |OPj .) 

The conjectural DT/PT correspondence of |PTj asserts (for any 3-fold X) that Z^'^{X) = 
^redDT^j^^ for any /3 G H2(X). In particular, this would imply 

(16) (-m)^(2-2c,+d)^GW(^) ^ (_^)(-V2)(2-29+d)^PT(^)^ 

In fact, it is expected that the same TQFT method used to compute the GW |BPlj . |BP2| 
and DT [OPj invariants of E can also be used to compute the PT invariants of E, thus 
establishing (fT6|) . 
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Let us now focus on the case 6 = 2, which we will study throughout. The explicit 
formula 

(17) Z^'^id) = (t.t)4f-4-2'^4^-i(2sin|)2'^((l+sin|)'^+i-5 + (l-sin|)^+i-^) 

= int)^^-^-^'2^^-\2sm^r^(^+^-^) 2(sin |)2^ 

i 

= iut)^'~^-^''Y.('^^2z~^) 2'^-'-'^(2sin^)2*+2'^ 

can be found in Section 8 of |BP2] 1 (The binomial coefficient should be defined as in 
|ACGH| so that the usual binomial expansion holds for negative exponents.) When 6 = 2, 
([T6|) specializes to 

(18) u^-'s+'^'Z^'^id) = q^a-^-'^Zrid). 

Under the change of variables — g = e*", we have (2 sinu/2)2 = q~'^{l+q)'^ ■, so by combining 
(jl7p with (|18p we arrive at the (conjectural) formula 

(19) Zr{d) = t^9-^~^dY^(^+]^-9^2''^-^-^'q^-^3-i^l + qfd+2^ 
for the residue PT invariants in degree 2[C]. 



4. Maximal Subbundles 



Let be a rank 2, degree d vector bundle over a genus g curve C. Define integers 
e S {0, 1} and e by the formula 

g-l + e = d-2e. 

Let / be the largest integer such that a generic (rank 2 degree d) stable bundle contains 
a line subbundle of degree /. We wish to argue by dimension counting that f = e. Recall 
that the dimension of the moduli space of rank 2 stable bundles with fixed determinant is 
Sff — 3 ( jNSj . Theorem l(iv)). By definition of /, a generic stable bundle E fits into a SES 

0-^S->E-^Q^O, 

so the dimension of the moduli of stable bundles is bounded above by 

dim Pic C + dim P Ext^ (Q, S) 

since Q is determined by S because det E is fixed. On the other hand, stability of E implies 
Hom(Q,S') = 0, so the dimension of the Ext group can be read off from Riemann-Roch 
and we obtain an inequality 

35 - 3 < 5 - (1 - 5 + 2/ - d) - 1 

implying / < e. For the other inequality e < / it is enough to show that Hom(5, E) ^ 
for some S of degree e, which will follow from the construction (below) of the locus of 
such S as a determinantal locus in Pic*^ C together with the fact that the class of expected 

^It is a matter of definitions that, for integers fci,fc2 satisfying d = fci + fc2, the partition function 
GWb{g\ki,k2) defined in [BP2] is related to our ^p^(d) by 
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dimension supported on this locus is nonzero in homology. By similar dimension counting 
arguments, one can show that the dimension of Quot*^ ii^ is e for generic E, and that 
Quot*^ii^ is generically smooth (so it is smooth when e = 0). 

In case e = and E is sufficiently generic, the smooth space Quot*^ E is just a finite 
number of points; the fact that this number is 2^ was apparently known to Segre (in some 



form) in 1889 Seg . A "modern" proof via Grothendieck-Riemann-Roch and the Thom- 
Porteous Formula can be given fairly easily. We sketch the argument (following the proof 
of Theorem 3.1 in |LN] ) since it is relevant to our discussion of the geometry of the Quot 
scheme 

Choose a smooth canonical divisor j : D ^ C (so D is just 2g — 2 points of C) 
corresponding to a section Oc vanishing on D. Then we have an exact sequence 

(20) ^ Oc ^ ^ i*i*wc ^ 

on C . Let 

/, = (Id X j) : Pic^ C X L> ^ Pic^ C x C 

be the inclusion, 7ri,7r2 the projections from Pic^ C x C. Tensor (I20p with E, pull back 
to Pic*^ C y~ C and tensor with the dual of the universal degree e line bundle to get an 
exact sequence 

O^Li® ir^E ^ L'i®TT*2{E® ujc) ® l^l*tt^{E ® ujc) ^ 0. 

To save notation, set 

F := L'^ 7r*2{E (E) Loc) 

G := i^i* L^^ i^i*H2{E ® ojc). 

For a sufficiently generic E one can argue that R^ttuF = and that the number of 
maximal subbundles is the degeneracy locus of the map ttuF — > vri^G of vector bundles 
on Pic*^ C. (We will see in a moment that the difference in ranks here is 

cho(vri*F — vTi^G) = g — 1 = dim Pic*^ C — 1, 

so one expects this degeneracy locus to be zero dimensional.) By the Thom-Porteous 
formula, if this degeneracy locus is smooth and zero dimensional (which it will be for 
generic E), then the number of points in it is 

/ Cg{TTuG - TTuF). 

We adopt the notation of Section [2l The formula ^ for ci(Le) implies that it is 
topologically trivial on Pic^ C x D. Since l*L'^ (8) i*Tr2(E (8) wc) differs from l*L'^ only by 
tensoring with a bundle pulled back from D (hence trivial), it is also topologically trivial, 
hence so is vri^G and we have chvri^G = 4g' — 4. Using formula (jlOp . we have 

chF = (chL^)(^^ch£;)(^^cha;c) 

= {I - €7] - - 7]9){2 + d'n){l + {2g - 2)r]) 
= 2 - 27 + (55 - 5)r] - 2rje, 



of these statements make sense when C is P^, as long as one understands "generic" to mean "the 
splitting type is as balanced as possible". By semicontinuity, this is an open condition in families. 
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SO by GRR we compute 

ch7ri,,F = chvTiiF 

= 7ri,((chF)(td7ri)) 

= 7Tu{{2 - 27 + (5(7 - 5)7? - 2ri9){l + (1 - g)ri)) 
= 55-5-26*. 

Since ch(7ri^,G — vri^-F) = 1 — g + 26, it follows from an exercise with symmetric functions 
(c.f. page 336 in |ACGH) ) that c{ttuG — ttuF) = exp(20), so finally we compute 

{26)3 



/ Cg{7ruG - TTuF) = / 
Jpic" c JP 



Pic^ c ff! 



2^^ 



usmg 



Let us see how to intepret the 2^ maximal subbundle count as a DT=PT invariant. If 
we expand (jl9p as a Laurent series in q, the smallest power of q with nonzero coefficient 
occurs when i takes the value e determined by the equation 

g-l + e = d-2e 

(e G {0, 1} as usual). When e = (i.e. when d and g have opposite parity), this lowest 
order term is 

^4g-4-2d23g-2-d^2-2g-e 

SO the DT=PT invariant in minimal Euler characteristic is given by 

(21) P2-2g-e,2{d) = t49-4-2d23<;~2-d_ 

The equality of DT and PT invariants in minimal Euler characteristic as discussed in 
13.31 together with the known equivalence of DT and GW mentioned above, ensures that 
this is actually the correct PT invariant even though the coefficients of higher powers of q 
are technically only conjectural. 

Assume we are in the e = case so g — 1 = d — 2e. Let Y be the space (Quot scheme) of 
such minimal (i.e. degree e) line subbundles of E. As mentioned above, if E is sufficiently 
generic, Y is just a finite number of points. On the other hand, we can identify Y with 
the T-fixed subscheme of 

P '■= l2g-2-e{E, 2) = P2g-2-e{E, 2) 

using Theorem 15.31 below (or by using Proposition 15.11 and the general remarks about 
this common moduli space in minimal Euler characteristic). Since Y is smooth and zero 
dimensional, the tangent space to y at a point L ^ E \s zero. On the other hand, this 
tangent space is given by Hom(L, Q) = H*'(C, Q), where Q = E/L as usual. The degree 
of L^Q is — e + d — e = g — 1, so by Riemann-Roch, we also have H^(C, Q) = 0. Let 
Z = SpeC(^ Oci-^^] be the degree 2[C] curve in E corresponding to a point L € y. The 
DT=PT deformation and obstruction spaces at this point are given by 

Ji\Z,Nz/E),'i^\Z,Nz/E) 

respectively. This is a consequence of the results of Section [6l as mentioned in Re- 
mark I6.1.1[ In fact, the statement about the deformation space can be seen directly, 
since the moduli space in question is a Hilbert scheme. The identification of the obstruc- 
tion space can also be derived from Proposition 4.4 in [PT] (or its proof). The point is that 
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the stable pairs in question are of the ideal form: they are structure sheaves of embedded 
CM curves. 

We will see in the next section (Equation [23]) that the normal bundle fits into a SES 

^ ^ ^^^^ _^ _^ Q 

Since vr is an afHne morphism, we can compute global sections (and the higher direct images 
of pushforward to a point) by first pushing forward to C via vr. Note 11^71*0 = G © GL"^ 
for any sheaf G on C, so pushing forward this exact sequence to C we have a SES 

^ Lt © L^t ^ TT^Nz/E ^Qt® {QL^)o 

on C, where the subscripts indicate the weight of the natural T action. We've already 
observed that 

hO(C, QL^) = h1(C7,QL^) = 0, 

so the fixed part of the T-equivariant POT on Y is trivial, and the virtual fundamental 
class on Y is its usual fundamental class. We conclude that the entire POT is moving, so 
the virtual normal bundle (at a point [L ^ E) ^ Y) is then 



Nflyp = R''{Z,Nz/E)-iiHz,Nz/E) 

= R'>{C,Q)t + lf{C,L)t + R^{C,L 



)2t 



- {C, Q)t - (C, L)t - (C, L^)2t 

(viewed as an element of the T equivariant K group of a point). By Riemann-Roch we 
have 

x{Q) = l-g + d-i 
X{L) = l-g + e 
X{L^) = l-9 + 2e, 

so we compute 

Since the DT=PT invariant is given by 

P2,-2-e,2(^) = E^^(-^{t}/p) 

|'^y^-j22g— 2— d^3g— 3— d— 2e 

we see that ^Y = 2^ by using the known value of this DT=PT invariant given in (j2ip . 

Notice that P2g-2-e(-E', 2) actually counts the number of T-invariant CM curves in 
class 2[C] in a generic E. To my knowledge, there is no such reasonable enumerative 
interpretation of the residue Gromov-Witten invariants. 

Of course, if one wishes to compute this minimal Euler characteristic PT invariant 
without using deformation invariance and the choice of a generic E, then one simply 
replaces the 2^ maximal subbundle count with the virtual class formula of Corollary 
and the general formula ()33p for exi—N™) which we will derive later. 
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5. T FIXED CURVES AND PAIRS 

The main goal of this section is to identify the CM curves and stable pairs on E fixed 
by the scaling action. As mentioned in the Introduction, we will only treat the case of 
homology class 2[C] G H2(-E,Z) here, leaving the general case for jGil2] . Though it is 
not used elsewhere, we have also included a description of the fixed locus of the zero 
dimensional Hilbert scheme of the total space of a line bundle L on C (Theorem I5.2p . 

Proposition 5.1. Let ir : E ^ C be a vector bundle over a smooth curve. Suppose Z Q E 
is a proper CM curve in E invariant under the scaling action and in homology (or Chow) 
class 2[C]. Then Z is the doubling of the zero section along a line subbundle L C E. 

Proof. Certainly such a Z must be supported on the zero section, so Oz = tt*Oz is a 
sheaf of Oc-algebras. Since Z is T-invariant, Oz has a grading making Sym* E"^ — )• Oz 
a surjection of graded Oc-algebras. Since Z is CM, each graded piece of Oz must be a 
locally free Oc-module, else its torsion submodule violates purity. Since Oz has length 2 
at the generic point of C, Oz is nonzero only in grading zero (where it must be Oc since 
Cc = Sym'' E^ surjects onto it) and one other grading. Since Sym* E'^ is generated in 
grading 1, this other grading must be 1 and we have a surjection E"^ i^z)i in grading 
1. The locally free sheaf sheaf L := [Oz)X C E must be a line bundle because of the 
homology class requirement. Evidently Oz = OclL"^] is the trivial square zero extension 
of Oc by L^. □ 

Remark 5.1.1. Note that the T- fixed subscheme of such a Z is nothing but the zero 
section C. The scheme Z is l.c.i. and hence Z is a Cartier divisor when E has rank 2. 
The map vr : Z — )• C is flat and finite of degree 2. We can compute xi^z) by first pushing 
forward to C: 

x{Oz) = x{Oc e L^) = 25 - 2 - degL. 

Since Z is the first infinitesimal neighborhood of C in L, we also have a closed embedding 
i : C — 7> Z corresponding to the surjection Oc[L^] — > Oc with kernel . Evidently 
vrt = Idc- We find that 

L*^* = Id 
= Id 

We now assume E has rank 2. 

Remark 5.1.2. One can show similarly that such a Z in class 3[C] is either Spec ©(^[-E^] 
(the first infinitesimal neighborhood of the zero section in E) or the second infinitesimal 
neighborhood 

S^ecciOc ® L"" ® L""®^) 

of the zero section in a line subbundle L <Z E. The latter is l.c.i. in E while the former 
is not even Gorenstein. Which of the two has smaller Euler characteristic depends on the 
relationship between d and g. One can again describe and filter the normal bundle as in 
the above proof. 

Let Z := Spec ©^[L^] be the doubling of C along L ^ £^ as in the proposition, and let 
/ be the ideal sheaf of Z in E and Q := E/L the locally free quotient. Then we have a 
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short exact sequence 

(22) ^ 7r*Q^ ^ ^ 7r*L^2 ^ q 

of sheaves on Z. To see this, note that / is defined by the SES 

-> / ^ Sym* E"" ^Oz^ 0, 

which we can analyse grading by grading. In grading zero the second map is an isomor- 
phism, so /q = 0, and in grading 1 it is — )• L^, so 1\ = . In higher gradings the 
second map is zero, so /„ = Sym" E'^ when n > 2. Now we analyse the inclusion and 
the inclusion C / in each grading; we will write for the degree n part {P)n of P. 
We have if = 0, so = . We have /| = Sym^ Q"^ , so 

(1/1% = Sym^ Sym^ = i?^ 

by linear algebra. In grading 3, /| ^ Is is 

Q"^ Sym^ E"^ ^ Sym^ 

and the quotient {I/l'^)^ is by linear algebra. In grading n > 3 we have /„ = I^. 
Thus, as a graded Oc module we have 

and this has the "obvious" structure of a locally free Oci-^^^J-module of rank 2 (the direct 
sum decompositions here and elsewhere are only as Oc modules, not as Oz modules). 
We have 7r*G = G L^G for any Oc-module G, so tt*Q'^ = Q"^ L^Q^ and the natural 
injection 

of Oc-modules is in fact easily seen to be an O^-module map with quotient 7r*L^^ = 
0^v3^ In fact, the dual 

(23) 7r*L2 ^ Nz/L 7r*Q 

of the exact sequence (I22p is nothing but the normal bundle sequence 

^ Nz/L ^ Nz/E ^ Nl/e\z ^ 0. 

Theorem 5.2. Lei ir : L ^ C be a line bundle over smooth curve endowed with the scaling 
action. Then there is an isomorphism of schemes 

]JC7'(^VAutA^ (Hilb"L)^, 

A 

where the coproduct is over partitions A ofn, /(A) denotes the length of \, and Aut{X) is 
the automorphism of group of X. 

Remark 5.2.1. It is interesting that (Hilb" L)^ does not depend on L, though, for ex- 
ample, its normal bundle in Hilb" L does depend on L. 

Proof. We begin by constructing a map from the LHS to the RHS. Let A = (1)"^'^ ■ ■ ■ (/c)*"* 
be a typical partition of n, so 

Ittt-i + 2m2 + • • • + kmk = n. 

Let 

X := C7'W/AutA 

= Sym^i C X • • • X Sym"'= C 
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and let tt^ : X Sym"*' C be the projection. Let Zi C Sym™* C x C be the universal 
Cartier divisor, let Wj := (tTi x n)*Zi be its puUback to X x L, and let /j C OxxL be the 
ideal oiWi'm. X x L. Let 

J := Sym^i tt^L"^ 
be the ideal of X x C in X x L. Consider the ideal 

K := h - ■ ■ Ik + h - ■ ■ hJ + h - ■ ■ hJ"" + ■ ■ ■ + IkJ'''^ + J*^ C OxxL. 

Notice that K is generated by "monomials in J" so the subscheme Z C X x L that it 
defines is certainly T invariant. 

I claim that Z has length n at every point of X. Since C K, certainly Z is topolog- 
ically supported on X x C C X x L; in fact it is scheme theoretically supported on the 
[k — l)-st infinitesimal neighborhood of X x C in X x L and is relatively zero dimensional 
over X. Let D = {Di, . . . , D^) be a point of X and let 

Zd C {D} X L = L 

be the zero dimensional subscheme of L determined by Z at D. For a point P E C and a 
zero dimensional W G C, write £{W, P) for the length of W at P. Then by definition of 
X we have 

Y,^{Di,P) = mi 
PeC 

and we want to prove 

i{ZD,P) = mi + 2m2 H h knik = n, 

PeC 

so it suffices to prove 

e{ZD, P) = iiDi,P) + 2e{D2,P) + ■■■ + ki{Dk, P) 

for each P G C for then we get the desired equality by summing over P. Set 4 := l{Di, P) 
to ease notation. Let x be a local coordinate on C centered at P (a generator of mp C 
Oc.p if you like) and let y be a local coordinate in the L direction corresponding to a 
trivialization of L near P. Then, at P, the ideal /j is given by (x^*) and the ideal J is 
given by (y), so at P, the ideal K is given by 

and it is easy to see, by drawing a picture of the corresponding Young diagram, that this 
monomial ideal has length £i + 2^2 + • • • + kl^ at the origin P. 

We have proved that Z is a flat family of T-invariant length n subschemes of L param- 
eterized by X, hence we obtain a map X — ?• (Hilb^L)^. Taking the coproduct of these 
maps over all partitions gives the purported isomorphism. To see that this is in fact an 
isomorphism, recall that Hilb" L is smooth, hence so is the T-fixed locus (Hilb" L)^, so by 
general nonsense we may conclude that our map is an isomorphism of schemes simply by 
checking that it is bijective on points. Suppose Z C L is a zero dimensional T invariant 
subscheme of L corresponding to a point of (Hilb" L)^ . Then at each point P if we choose 
local coordinates x,y on L near P as above, then the ideal I of Z at P can be generated 
by monomials in y since Z is T invariant. The coefficient f{x) of a monomial is an 
arbitrary polynomial in x, but if we factor out the largest power of x dividing f{x), then 
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what is left over is a unit near P. We find that / is a monomial ideal at P, so we can 
write it uniquely as 

for some nonnegative integers ii (P) ,lk {P) (independent of the choice of coordinates 
x,y). Set nii := YlpeC^ii-P)- Then the fact that Z has length n easily implies 

mi + 2m2 + • • • + kruk = n 

and it is easy to see that Z is in the image of the component on the LHS corresponding 
to this partition of n. □ 

Theorem 5.3. There is an isomorphism of schemes 

]J Quot^ E X Sym" C ^ P2-2g+m{E, 2f. 

2n—e=m 

Proof. First wc define a map from the LHS to the RHS. Let Y := Quot^ E x Sym" C to 
ease notation. Let 

O^S^ TT^E ^ Q ^ 
be the universal sequence on F x C pulled back from Quot^ E x C and let 

SD ■■ OyxE Oyxe{D) 

be the puUback of the universal section of the universal Cartier divisor on Sym" C x C via 
the projection Y x E ^ Sym" C x C. Let 

i:Sym^^^^7r2*i?^^Oyxc[5l 

be the induced map on symmetric algebras obtained by quotienting Sym* 5^ by the ideal 
Sym-^ , viewed simply as a map of graded Sym* it2E^ modules. In degree 1, 

may not be surjective since Q may not be locally free. However, the sheaf F := Oyxc[S^] 
is certainly a pure sheaf, topologically supported on C at each point of Y. Composing 

t : OyxE ^ F 

with the natural map 1 : P — >■ F{D) defines a map 

s : OyxE ^ F{D), 

which is evidently a family of stable pairs over Y with the correct discrete invariants. 
Furthermore, s is clearly a graded map of graded sheaves (with F(D)q = Oc{D) and 
F(D)i = S*^ (£))), hence it defines a T invariant stable pair, that is, a morphism 

Y P2-2g+miE, 2)"^. 

Now we define a map from the RHS to the LHS. Suppose s : Oe ^ F is m P := 
P2-2g+n{Ei 2)^- Then, pushing forward to C, we may view s as a graded map of graded 
Sym* modules 

s : Sym* E"^ F. 

By purity of F, each graded piece F^ must be a locally free Oc-module. Since s has 
zero dimensional cokernel, sq : Oc Fq must be a map of locally free sheaves on C 
with zero dimensional cokernel, so it must he sd '■ Oc — > Oc{D) for some Cartier divisor 
D C C. Since Fq varies flatly over the universal family, so does D, and we obtain a 
map P — > Sym'^C for some d. In degree 1, s is a map si : E"^ — > Fi. The condition 
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[SuppF] = 2[C] and the fact that Sym* E"^ is generated in degree 1 ensure that the 
locally free sheaf Fi has rank 1, and Fi = for i > 1. The fact that s is a map of graded 
Sym* E"^ modules means we have a commutative diagram 

Oc^^E-^Fo 




expressing the compatibility (with s) of the action a of Sym* E"^ on F and the action of 
Sym* i?"^ on itself by multiplication. Using our identification of sq = we may view 
this diagram as providing a factorization of si through a map t : E"^ — )• Fi{—D). Since 
Cokt has zero dimensional support, we have J^om{Cokt,Oc) = 0, so : F^ (D) — t- E 
is monic. Noting that F^ (D) varies flatly over P, the dual of t therefore yields a map 
P —7- Quot*^ E for the unique e satisfying 2n — e = m. Taking the product of this map and 
the previous map we get a map P ^ Y. 

Since the two maps are easily seen to be inverse, the isomorphism is established. □ 

Remark 5.3.1. Observe that the sheaf F = OciS"^] in a stable pair as in the above 
theorem is itself the structure sheaf of a (Cohen-Macaulay) curve with the same topological 
space as C (namely the first infinitesimal neighborhood of the zero section C in S). The 
section s may be viewed as a (finite) map of schemes s : Spec^ F ^ E (over C) which 
factors through the inclusion 

Z = SpeccOc[L'^] ^ E 

and which is generically an isomorphism onto Z. Locally, where S and L can be trivialized, 
s : SpecQ — > Z looks like Spec,^ of the map of Oc-algehias 

Oc[y]/y^ ^ Oc[z\/z'' 
y ^ fz 

for some / G Oc- 

In particular, (F, s) defines a point of Honsen's moduli space of finite maps from CM 
curves to E, which is in keeping with the original motivation for considering the stable 
pairs space. It might be interesting to compare the deformation theory of the stable pair 
(-F, s) with the deformation theory of the map s : Spec,^ F ^ E, possibly viewing the 
latter in some moduli space where the domain of the map is also allowed to vary. 



6. Obstruction Theory 



In this section, we will identify the POT on 

Y := Quot^^ X Sym"C7 

inherited from the fixed part of the stable pairs POT via the isomorphism of Theorem 15.31 
as well as the virtual normal bundle of Y in the stable pairs space. It will be helpful if the 
reader is familiar with virtual localization [GPj . A more general study of this POT can 
be found in [Gil2] . 

In general, if P = Pn{X,/3) is a stable pairs space and I* is the universal stable pair, 
then an important fact ( |PT] . 2.2) subtly alluded to above is that P can also be viewed as 
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a moduli space of derived category objects. In particular, if j : [/ — > P is determined by a 
stable pair I' = [OuxX F] parameterized by U, then I' = L{j x Idx)*I' in D{U x X). 
We will use this when j is the inclusion 1" P of a component of the T fixed locus. The 
POT on P is given by a morphism 

KTT^KJ^om{r ,r)o (g) uj^[2] Lp 

in D{P) to the cotangent complex of P defined using the Atiyah class of F (see [PT], 2.3). 

The virtual normal bundle of y in P is, by definition, the image of the moving part of 

(24) Lj*R^om(R7r*R^om(r,r)o (8)a;^[2],Op) 

under the map DxiY) — >■ Kt{Y) from the (perfect T equivariant) derived category of 
Y to its Grothendieck ring. The T fixed part of (j24p defines a POT on Y (using the 
isomorphism (Lj*Lp)-^ — t- Ly) which we will also have to identify. Using Serre duality 
for vr, cohomology and base change for the square 

Y X E— ^P X E 



Y ^P 

and the (obvious) "self duality" 

Rjrom(r,r)o = RJ^om{KJfom{r,r)o,OpxE), 
we can rewrite ()24p : 

L j* R J^omCR TT^ R J^om{r , F )o [2] , Op) 
= Lj*R7r*R=^om(R^om(F,F)o «) w^[2],a;^[3] 
= R7r*L(j X IdB)*R^om(F,F)[l] 
= R7r*R^om(L(j x Id£;)*F,L(i x Idi5)*F)o[l] 
= R7r*R^om(I',/')o[l]. 



6.1. Notation. Let p -.Y x C ^Y and n : Y x E ^ Y he the projections, l : Y x C ^ 
Y X E the zero section, so p = ttl. We drop all notation for pullbacks, so we will just write 

0-^S^E^Q->0 

instead of 

^ ttI^S TT^E ttI^Q 

for the pullback to y x C of the universal sequence on Quot^ E x C. Similarly, we write 
D C y X C instead of 7r23-D for the pullback of the universal Cartier divisor, we write O 
for OyxC a-iid sometimes we just write D for the invertible sheaf 0{D). Let F' = OlS"^], 
F = D[S'^ D\, and let /* = [O — > F] be the universal stable pair on y x as described in 
the proof of (jS.Sp . The pair I* corresponds to the map j '.Y P giving an isomorphism 
onto a component of the T fixed subscheme. 

Lemma 6.1. The virtual normal bundle ofY in P is given by 

(25) Npjp = piiS^D + D"^ A^E + D'^SA^E + 2E + SE) 

-piiS"^ + 2 a"^ E + S a'^ E + S + S"" E) G Kt{Y). 
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Proof. This is easy to prove because we can calculate everything on the level of the (T 
equivariant) Grothendieck rings Kt = Kt{Y x E), Kt{Y x C), and Kt{Y). We just need 
the classes of various derived duals — these are easier to calculate than actual duals or Ext 
groups. We seek a formula for the moving part of 

-TT\RJ^om{r,r)o = mOYxE-mYijeom{rj') 

in K^iY) (the minus sign results from the shift [1]). The filtration oi F = D[S"^iD] by 
gradings 

^ F-^ ^ F ^ F/F-^ 

is identified with 

^ L^S'^D F ^ L^D ^0, 
so we have F = l^,D + i^S^ D in Kt{Y x E). The Koszul complex 

(26) F^ ^ F^ ^ Oy^E ^ i^Oy^c 

is a (T-equivariant for the obvious actions) resolution of by vector bundles on y x F. 
Similarly, if G is any vector bundle on y x C, we can resolve i-^G by tensoring (j26p with 
7r*G, so we have 

i^G = GiA'E"^) 

in Kt- Here we have denoted multiplication in Kt by juxtaposition (so we often just 
write 1 for a structure sheaf) and we use the shorthand A'E := X]i(~l)* ^- 
just reproducing the proof of GRR for l.) 

For the rest of the proof we use F'^ , (F')^ for the classes of the derived duals in Kt- 
Putting the Koszul resolution together with the filtration of F, we find that 

F = i^D + i^S^D 

= {D + S''D){A'E'^) 

= (D^ a2f + Z)^5a2f)(A'F^) 

= L^D"^ a'^ E + S E) 

FF^ = {F'){F'y 

= (1 + 5)(1 + 5^)(A*F)(A*F^)) 

= l42 - 2E + 2 a'^ E + S - ES + S A^ E + S"^ - 5^F + 5^ A^ F) 

in Kt- Here we have used the "Koszul duahty" identity (A*F)(A^F'^) = A*F^, which is 
basic linear algebra. Since /* = Oyxe — F in Kt, we have 

Kjrom{I',r) = {Oyxe-F){Oyxe-F'') 

= OyxE + i*(2 + 2 A^ F + 5 + 5 A^ F + 5^ + 5"^ A^ F) 
-i^{D + S'^D + D'^ A^ E + D^S A^ E + 2E + SE) 

in Kt{Y x F). We can subtract off the first term to get the traceless part. The T-fixed 
part of this expression is 

i^{2-D-S^E), 

which we can discard to get the moving part. The result now follows because vrt = p, so 
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Remark 6.1.1. There are several situations where the virtual normal bundle formula 
simplifies dramatically. If re = 0, then D = 1 in the Grothendieck ring and we have 

(27) Np]p = pi{2E + SE)-pi{A^E + S + S'' a"^ E) e Kt{Y). 

If, furthermore, we restrict to the locus U ClY where 5 is a subbundle (i.e. where Q is 
locally free), then we have A^E = SQ and E = S + Q. The formula becomes 

(28) Npjp = p,{S + Q + S^) eKriY). 

On this locus, the line subbundle L generated by 5 coincides with S, which is to say: 
the universal stable pair is nothing but the structure sheaf of an embedded curve Z C E 
(really: a flat family of embedded curves Z C U x E) . Using the formula (j23p . we 
recognize S + Q + S"^ as the class of the moving part of the normal bundle Nz/uxE iii the 
Grothendieck group (the fixed part of the normal bundle is our old friend S'^Q). 

In the course of the proof we saw that the T-fixed part of (j24p was given by 

p\{D-2 + S'^E) = pi{D -1 + S'^Q) 

= Kp^{OD{D)(BJ^om{S,Q) 

in the Grothendieck ring. Our next step is to lift this equality to the actual derived 
category. We begin with the case re = 0. 

Lemma 6.2. When n = 0, the T-fixed part of (124p is isomorphic to Yip^^om{S,Q). 
The T-fixed stable pairs perfect obstruction theory gives rise to a virtual class 

[qnoi' EY'' € ^i_g+rf_2e (Quotas). 

Proof. The sheaf F = Oyxc[S'^] onYxE admits a T-equivariant (i.e. graded) locally 
free resolution 

whose first few graded pieces look like: 

OyxC 

E^ S'^^E^ 

5^ a2 e a2 ^ Sym^^^S^eSym^^v^v ^ Sym^ Sym^ 

(here we write, e.g. Sym^ ^^5^ for (Sym^ E^) as opposed to Sym2(^v ^ ^V))_ ^hat 
is, all the rows except the first are exact except the cokernel of the rightmost map in the 
second row is 5^. 

Appyling J^om{ - ,F) to this, we get a complex quasi-isomorphic to 'RJifom{F,F). 
Its graded pieces look like: 

sa'^e 

SE A^E © A^E 

S E®E S'^ A^ E 

Oyxc^Oyxc ^ S^'E 

From a brief inspection of the boundary maps, two things are clear: (1) The kernel of the 
leftmost map is just F, so J^om{F, F) = F (we could see this directly anyway) and (2) 
In grading zero, the T-fixed subcomplex (the penultimate row above) is cohomologically 



MAXIMAL SUBBUNDLES, QUOT SCHEMES, 



AND CURVE COUNTING 



31 



formal (quasi-isomorphic to the direct sum of its shifted cohomology sheaves). That is, 
we have 

KJifom{F,F f = OcxY ® S'^Qi-l] 

= J^om{F,Ff ei^J^om{S,Q)[-l] 

in D(Y X E). 

Similarly, if we apply J^om{ _ , Oyxe) to the above resolution of F, we get a complex 
quasi-isomorphic to RJfom(F, Ox)- Its first few graded pieces look like 

SA^E 

SE A^E^E'^SA^E 
S E®E'^SE E"^ E (B Sym^ E"^ S E 

OyxC^E'^S E"" E (B Sym^ E'^SE Sym^ E"^ A^ E ® Syui^ E"^ S a'^ E . 

Examining the boundary maps and doing a little linear algebra, we can see that all the 
rows are exact except the first two. In particular, the T-fixed subcomplex (the bottom 
row) is exact, hence quasi-isomorphic to zero. The map in the second row is monic with 
cokernel a'^E, and we see that 

KJ^om{F, Oyxe) = F®tt*S A^ E[-2]. 

In fact, for any stable pair Ox F, we always have 

KJ^om{F,Ox) = £'xt'^{F,Ox)[-2] 

because the sheaves (oxf{F,Ox) vanish for i ^2 because F is supported in codimension 
2 and has cohomological dimension < 2 (c.f. Page 10 in [PT3) ). 

The rest of the argument is quite formal, but we include it for completeness. Applying 
¥iJ^om{ _ ,Oyxe) to the triangle 

F[-l] ^ /• ^ Oyxe, 

we get a triangle 

OyxE RJ^om{r,Ox) Rjrom(F[-l],OyxE). 

Examining the associated long exact cohomology sequence and using the established van- 
ishings, we find: 

Jfom{r,OYxE) = Oyxe 
<^xt\r,OYxE) = <^xt\F,Ox) 

Sxt\r,OYxE) = 0, 

Applying YiJ^om{ _ , Oyxe) to the same triangle, we get a triangle 

F[-l] ^ Rjrom(/',F)[-l] ^R^om(F,F) 

whose long exact cohomology sequence looks like 

^ ^xt-^{r,F) M'om{F,F) 
^ F ^ J^om{r,F) (^xt^{F,F) 
^ ^ ^xt^{I\F) c^xt\F,F). 

The map J^om{F, F) F is the one induced by s : OyxE — > F and is given by ^ 
4>{s{l)). It is easily seen to be an isomorphism since this F is in fact a sheaf of OyxE 
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algebras (Remark I5.3.ip . hence we can use the multiplication by any local section. We 
conclude: 

J^om{r,F) = ^xt^{F,F) 
^xt\l',F) = ^xt'^{F,F) 
c^xt\I',F) = 0, i/0,1. 

Finally we apply RJ^om( _ ,/*) to the same triangle to get the following long exact 
sequence: 

— )• OyxE OyxE 

<gxt^{F,F) ^xt^{r,r) ^xt^{r,OYxE) 

S'xt'^{F,F) >gxt\l\r) 

The map in the first row is an isomorphism (c.f. Lemma 1.20 in [PT] ) and we have already 
established the vanishings 

c^xt\r, OyxeV = '^xt\F, OyxeV = 

and i§xt^{F,F)'^ = 0, so we have: 

i*jrom(5,g) = >^xt^{F,Ff = £xt\r,r)^. 

Since scalar multiplication OyxE J^om(I' , I') is an isomorphism and the trace map 
splits this off of HrJ^om^I* , I') we may in fact view the above isomorphism as an isomor- 
phism 

^J^omiS,Q) = R^om(/*,/')^[l] 
in D{Y X E). Applying Rtt* and noting that R7r*t* = Rp* completes the proof. 

□ 

Remark 6.2.1. One can check that this virtual class on Quot*^ is the "well known" 
[CFK] . [MO] class discussed in Section ESI 

We can use the same technique to handle the general case. 
Theorem 6.3. The T-fixed part of the stable pairs POT (1241) on Y is given by 

Kp^Jifom{S, Q)®T Sym"' C, 
hence the corresponding virtual fundamental class is 

[Quotas]"'' X [Sym'^C], 
where [Quot^ i?]^''^ is the virtual class on Quot^ as in Lemma \6.S\ . 

Proof. According to the proof of (|5.3p , the universal stable pair on y x is 

I' = [OyxE^FI 

where F = F'{D) is obtained from F' = OyxcIS"^] by tensoring with the section OyxE 
Oyxe{D) determined by the Cartier divisor D C Y x E. Note F' is pulled back from 
Quot*^S X C and D is pulled back from Sym'^ C x C. In particular, Oyxe{D) is locally 
free, so we have equalities: 

KJ^om(F'{D),F'{D)) = Kjeom{F',F') 

KJ^om{F'{D),OYxE) = Kjeom{F',OYxE){-D), 
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and so forth (we have used the Grothendieck groups analogues in the proof of Lemma [6.ip . 
In particular, we can see that 

RJ^om{F'{D),OYxEf = 0, 

just as we did in the proof of Lemma |6.2[ 

The only departure from the proof of Lemma[6]2]occurs when we apply R J^om{ _ , Oyxe) 
to the triangle 

F'{D)[-l]^r ^Oyxe- 
This time the long exact cohomology sequence looks like 

^ £'xt-^{r,F'{D)) ^om{F',F') 
F'{D) ,^om{r,F'{D)) Sxt^{F',F') 

^ ^ (^xt^{I',F'{D)) Sxt^{F',F'). 

As in the proof of Lemma [6.21 we have Jifom{F' , F') = F' , and the map ,J^om{F' , F') 
F'{D) is the obvious one. The T fixed part of this map is the usual map OyxC ~^ 
Oyxc{D) whose cokernel is Od{F>), so the T-fixed part of the middle row yields a SES 

^ Od{D) £xt\r,F'{D)f ^xt\F',F'f 0. 

This sequence splits using the identification S'xt^{F', F')'^ = S'xt^{I* , F')^ from the proof 
of (I6.2p and the natural inclusion 

<^xt\r,F'f ^ <^xt\r,F'f(.D) = <^xt\r,F'{D)f. 

Exactly as in the proof of ()6.2p we obtain an identification 

L^J^om{S,Q)®OD{D) = Rjrom(/',/')(^[l]. 

Finally, we use the standard formula 

TSym'^C = jrom(/D, Cd) 

= p,M'om{Os^^,cxci-D),D) 

for the tangent space of the (smooth) Hilbert scheme Sym*^ C. □ 



7. Computations 

Consider the expression for the virtual normal bundle of y = Quot*^ E x Sym" C in 
P = P2-2g-e+2n{E,2) given in Lemma [6Tl It is clear from GRR that eTi—NyJp) can be 
expressed in terms of tautological classes on Y; therefore 

(29) / eri-NpJp) G Z[t,t-'] 

can be computed using Theorem 12.51 The purpose of this section is to write out an 
explicit formula for eT(— -/Vy/p) and calculate (I29p in various cases. A full reconciliation of 
our computations with the prediction of Equation [19] poses combinatorial difficulties not 
addressed herein. On the other hand, the formula derived below is simple enough that it 
is feasible to compute any particular invariant Pn,2{d) (with minor computer assistance). 
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Notation. Let 7ri,7r2 be the projections from Y to Quot*^ i?, Sym" C, respectively. Let 
oi G H^(y) be the puhback of the a class on Quot^ via vri (Section I2.4p and let bi^i G 
H^(y) be the pullback of the bi class on Quof^S via vri. Similarly, let 02 € H^(y) be the 
pullback of the a class (the coefficient of r] in the Kiinneth decomposition of the universal 
divisor D C Sym" C x C) on Sym" C via 7r2 and let 62,* £ H^(y) be the pullback of the hi 
class on Sym" C. Set 0j := X]f=i ^j,i^j,g+i ^ H^(y), so 0j is the pullback of the 6 class on 
the Jacobian under the composition of tTj and the Abel-Jacobi map. 

It is convenient to set 

9 

B := ^ t>i,ib2,g+i — &l,g+i&2,i 
1=1 

SO that 



(30) 



^i=l / \j=l / 



in H*(y X C). Write ~ for equality in H*(Pic C) modulo odd monomials (c.f. Section [2. 4p . 
Then we have 



^ ^ l<h<-<ii<g 



For distinct ii, . . . ,im G {1, . . . ,g}, Theorem 12.51 yields 

(31) / a'-^+'-'^-^k,b,+,,---b,^b,+,^ = 2^-^ 

JlQuot" E]- ' 



' vir 



Since 



a" '^bi-^bg^i-^ ■ ■ ■ bi^bg+i^ — 1. 

Sym"C 



0^ = f- J2 bi^bg+i, ■ ■ ■ bi^bg+i^ 

l<il<-<ij<g 



and the product of an even and an odd monomial is odd it follows that ^■J^^i?'^' is equal 
(modulo odd monomials in the bi^i and 62,*) to 



(-1)' (^/) m\ 



times a sum of 

'9\ fa (9 -I 



terms of the form 

bi,iibi,g+ii ■ ■ ■ bi,ij+ibi,g+ij+M,iM,g+ii ' ' ' b2,ik+ib2,g+ik+r 
Since [y]"^ = [Quot" E^" x [Sym"C], the formula 

(32) / al-^^'-'^-^-^ar'-^eielB'^ = (-1)' ffl , ^'^^ " ^/^'T n, 
therefore follows from (j3ip after slight simplifications. 
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In this notation, we have 

ch^"" = e''''\l-^bi^i6i-erj-9ir]) 

i=l 

chD = e''Hl-Y,b2A + nv-02V) 
1=1 

in H^(y X C). To calculate, for example, exipiS"^ D), we first calculate 

ch S'^D = e'^i+»2-* ^1 + Ylih,^ + b2,i)d^ + {n-e-ei-e2- B)^ 

using (pOj) . then by GRR for p : F x C ^ y, we compute 

chp^S'^D = e«i+«2-*(l - g + n-e-Oi-Oi- B). 

Evidently p\S^ D has the same Chern character as the product of a line bundle with 
ci = oi + 02 — t and a (virtual) vector bundle of rank \ — g + n — e and total Chern class 
^-61-62-3 ^ so from the usual formula for the Euler class of such a product, we obtain: 

erip^S'^D) = (ai +a2 -t)i-^'+"-^exp f "^^~^^"f ^ 

V ai + 02 - i 

Similar calculations yield 

vir ^ eripiiS"" + 2 E + S E + S + S"" E)) 
^/P' ~ eripiiS'^D + D^ A^E + D'/SA-^E + IE + SE)) 

(ai - ty-9-%2tf-^9+^'^{3t - ai)^-g+^+^ 

~ (ai + 02 - t)i-9+"-^(2t - a2)i-9+'^-"(3t - ai - 02)1-^+'^+^-" 
(t-ai)^-g+^(t + ai)^-g+'^-'^ 

/ -^1 \ / -01 

■ exp exp I exp 1 1 exp 



ai — t J \3t — ai J \t — ai J \t + ai 

h+02 + B\ f 02 \ ( 61+62 + B\ f 26i 
■ exp I exp exp exp 



CLi + a2 — t J \2t — a2 J \3t — ai — a2 J \2t — ai ^ 

Expanding this out and integrating over [Y]™ using (|32|) presents no particular difficulty 
in any given case, though a simple general formula is difficult to obtain. 

When n = 0, Y = Quot*^ E, and this formula simplifies to 

, . ^.n . CTipijA^E + S + S'' A^E)) 

^H-A^y/P) = eT{p^(2E + SE)) 

(f)4-4g+2d(2i _ a)2-2g+d+2e 

26 

■ exp I I exp I I exp 



t — aj \t + a J \2t — a ^ 

29~2e— l^Sg— 3— ci— 2e 29^2e— 1^3g— 4— d— 2e^ 

^29-2e-2^39-4-d-2e(2 - 2g + 3d - 2e)a + ... 
where the . . . are terms in E?''^ {(^Moi^ E). 
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7.1. Expected dimension one. Suppose £^ is a rank 2 bundle on C whose degree d has 
the same parity as the genus g of C. Define an integer e by setting d — g = 2e. Then the 
smallest power of q appearing in the Laurent expansion of Z2'^[d) occurs when i = e in 
(fT9D . It is given by t4g-4-2d239-i-d((^ + i _ g^q2-d-g^ ^j^^ DT=PT invariant of E in 
minimal Euler characteristic is 

(34) P2~d-gAd) = t4s-4-2d23£,-l-d_ 

On the other hand, Theorem 15.31 provides an identification 

P2-d-g{E,2f = qnot'E 

(after possibly throwing away fixed components with negative expected dimension). The 
formulae 

/ a = 23 

[ = 52^-1 

are obtained by taking k = g,g — 1 (respectively) in (fT3]l . Using (f33]l . we then compute 



P2-d-g,2{d) = / eri-N^n 



_2S-2e-1^3g 



2e-l .3q-4~d-2e 



a 



1] vir 



^29-2e-2^35-4-d-2e^2-25 + 3d-2e) / 

^ _229-rf-1^4g-4-2d^^23-l) + 22^-^-2^49-4-2^(2 -g + 2d)(2^) 
_ ^4g-4-2d235-l-d 

in agreement with the formula (I34p obtained from the GW/PT correspondence and the 
equivalence of DT and FT invariants in minimal Euler characteristic. 



7.2. Target genus zero. When C = P the Jacobian is trivial so the Quot schemes 
are just projective spaces. We can identify the virtual fundamental class on the Quot 
scheme and explicitly compute the FT invariants from first principles (i.e. without using 
Theorem 12.51 or the GRR calculation above) . Consider the case where C = and E = 
0{di) e 0(^2), with d = di + ^2- 

If we make the identification 

Quot^ E X Sym" x ^ x P" x P^ 

(so p is the projection on the first two factors), then the bundles appearing in the vir- 
tual normal bundle formula of Lemma 16.11 are tensor products and duals of the following 
bundles: 

S = O(-l,0,e)t 

E = 0(0, o,(ii)te 0(0, 0,^2)* 

K^E = O(0,0,d)2i 
D = O(0,l,n)o. 
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We have used subscripts to keep track of the weight of the T action under these identifi- 
cations. (The description of the universal bundle on Sym" X is elementary and we 
discussed the universal bundle S on Quot^ x P^ in Section [2j) 

Lemma 7.1. Assume 1 + d — 2e > 0. If E is balanced, the virtual fundamental class 
on Quot^ E is its usual fundamental class. In any case, Quot*^ E is a projective space of 
dimension at least l + d — 2e and the virtual class is just the fundamental class of a linearly 
embedded projective space of the expected dimension 1 + d — 2e. 

Proof. As discussed in ([2]), 

Quof^ E = P(H°(P\ 0{di - e)) H°(P\ 0(^2 - e))). 

We have /i°(P\ - e) = 1 + di - e and /i°(P\ 0(^2 - e)) = 1 + d2 - e, so the moduh 
space is smooth of the expected dimension unless one of the 1 + — e is negative and the 
formula is invalid. They can't both be negative because we are assuming 

di — e + d2 — e > —1, 

and balancing will also ensure both expressions are nonnegative. Say 1 + di — e is negative, 
so we have: 

Actual Dimension of Quot*^ E = d2 — e 
Expected Dimension of Quof^ E = 1 + di + d2 — 2e 
Excess Dimension = e — di — 1. 

In this situation, 0{e) admits no nonzero map to 0{di), so every point of the Quot 
scheme will look like 

^ 0{e) ^ Oidi) © 0(d2) ^ © r ^ 0, 

where T is a torsion sheaf of degree d2 — e. The torsion sheaf doesn't contribute to the 
higher direct image under 

p : Quot^ E xF'^ Quot" E, 

and we compute 

Rip^S^Q = RV*(O(-l,e)^®O(0,di)) 
= R^p^O{l,di-e) 
= O(l)0cHi(IP\C(di-e)) 

using the projection formula. Since the virtual class is e(C'(l)^"'^i~i) p [Q^gt^ the proof 
is complete. □ 

Let Oi G H^(P^ X P") be the pullback of the hyperplane class along vrj (notice that 
the hyperplane class is the a class when the rank one Quot scheme is identified with a 
projective space). Because of the lemma, the actual value of 

N = dimHom(0(e),0(di) © ©(^2)) - 1 

will be irrelevant. When we integrate over [p^]^''' it will be as if 

N =l + d-2e. 

Pushing forward over the P^ factor is easy; the projection formula implies 

piO{a,b,c) = (c+ l)0(a,6) 
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in the Grothendieck ring. For example, we find 

eripiS) = {t - air+\ 

Since we now know how to work out the T equivariant Euler class of the virtual normal 
bundle, the computation of the PT invariant is is now just a matter of putting the pieces 
together: 

P2+m.2{d) = [ eT(-iV"0 

JP2 + n.{E,2)T 

eT(p!(5^ + 2a'^ E + Sa'^E + S + S'^ A^E)) 
eripiiS'^D + Z)v a2 ^ + D'^S A^E + 2E + SE)) 

l+d-2e>0 

= ^ C{d,e,n), 

2n — e—m 

l+d-2e>0 

where we define C{d,e,n) to be the coefficient of a\'^'^~'^^ a2 in the expression 

(ai - t)i-^(2t)2'^+2(3t - aiy+^+\t - aiY+^a^ + t)^-'^-^ 
(ai + 02 + t)i+"-^(2t - a2)i+°'-"(3t - oi - a2)i+'^+^-"(t)2'^+4(2t - oi)«'+2e+2 " 

Presumably it is possible to completely reconcile this with Equation [T9l but we will 
content ourselves here with a few explicit computations. 

7.3. Local Consider the bundle E = 0(-l)®2 on The stable pairs spaces Pm{E, 2) 
are easily seen to be compact, and each has expected dimension zero, so the residue 
invariants are bonafide integrals taking values in Z. The total space E is Calabi-Yau, 
so the invariants can be computed as weighted Euler characteristics of the moduli space, 
weighted by Behrend's constructible function (Lemma 1.3 in |PT3] . |Beh] ). The pairs 
space P4{E,2), for example, is discussed extensively in Section 4.1 of |PTj . It can be 
described as the closed subscheme 

P4iE,2) ^ Specpa Ops [Ops (2)] 

of the first infinitesimal neighborhood of P'^ in 0(— 2) determined by the ideal generated 
by sections of Ops (2) vanishing along a quadric P^ x P^ C P^. Locally, it looks like a 
product of 

Z = SpecC[x,y]/{y'^,xy) 

and A^. The normal cone of .Z^ C ^ has two irreducible components, one lying over the 
origin with length 2 at its generic point and one generically smooth component surjecting 
to the topological space \Z\ = |A^|, so the characteristic cycle ( jBehj . 1.1) of Z is = 
-[A^] + 2[0]. These cycles are smooth, so the local Euler obstruction construction of 
Section 1.2 in |Behj simply yields their characteristic functions, so Behrend's function is 
— 1 on the smooth locus and +1 at the origin. Since Behrend's function is local and 
respects products, we conclude that it is given by 1 on the quadric P-^ x P-*^ C P^ and — 1 
away from the quadric, so the pairs invariant is 

P4^2(-2) = -1 • x(IP^ \ P^ X P^) + 1 • x(P^ X P^) = -1 • + 1 • 4 = 4. 

From our point of view, we have 

Pi{E,2f = Quot-^ E = ¥Rom{0{-2), E) ^ P^ 
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The universal sequence 

on identified with the sequence 

^ -2) ^ 0(0, ^ Q ^ 

on X pi. The quotient sheaf Q restricts to O on {P} x for a generic P € P^, but Q 
restricts to the direct sum of 0{—l) and the structure sheaf of a point when P is in the 
stratum 

Quot~i E X Sym^ P^ ^ Quot'^ E 

discussed in Section [2l Of course, Quot-i£^ = PHom(C'(-l),S) ^ P^ and this stratum 
is exactly the quadric pi X pi .-^ p3 

along which the full stable pairs space has a Z x A'^ 
singularity. We can compute the PT invariant explicity using the method explained at the 
beginning of this section: 



P4,2(-2) = / eri-N^ 

J[Pa{E,2)TY^'' 



eT(-iV™) 



/ eriHS"" ^^E-2E + S + ^^E-SE)) 
erip^S"^ a2 E)eT{R^P*SE) 



P3 eT{R^P*S)eT{R^p* a2 E) 
eT{0{l)t)eT{0{-l)2tY 

eT{0{-l)t)eT{02t) 
{a + t){2t-aY 



P3 {t-a){2t) 
4a^ - Aah + 



According to (jl9p . the generating function for degree 2 stable pairs invariants of local 



"1 is 



-4/1 „\-2 



-2g^(l + g)-^(l 



oo > 
2e 



\d=0 / \e=0 



oo 



2E E ('i+i)(e+i)(-gr 

m=3 cZ+2e=m— 3 

-2g3 + 4g*^ - lOg^ + IQq^ - ISq' + ■■■ 
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Our computations yield 

Zn-2) = C(-2,-l,0)g3 + C(-2,-2,0)g^ 

+ (C7(-2,-3,-0) + C(-2,-l,-l))g5 

+ (C(-2,-4,0) + C(-2,-2,l))<76 
+(C7(-2, -5, 0) + C7(-2, -3, 1) + C7(-2, -1, 2))^^ + ■ ■ ■ 
= -2q^ + 4/ + (18 - 28)g^ + (424 - 408)g'' + (7750 - 8404 + 626)5"^ + • • • 
in complete agreement. 
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